Python Job: Senior Data Engineer

Senior Data Engineer- Bank of Ireland - Republic of Ireland/Northern Ireland

Bank of Ireland Group is an equal opportunities employer and is committed to fostering an inclusive workplace which values and benefits from the diversity of our workforce.

Bank of Ireland are delighted to be hiring a Senior Data Engineer to join our Chief Data Office team!

Strategic Analytics create data-driven solutions to support the business. We collaborate with other specialists in a hub and spoke network, spread capability awareness and develop new talent. The team is built on three pillars: strategic value prioritisation, design thinking and agile delivery.

Join us and accelerate the adoption of Analytics & AI to transform the bank, engage our customers and deliver value!

Who are We

Working with the Chief Data & Analytics Officer (CDAO), the Strategic Analytics & AI team is responsible for the development and execution of the Bank's data analytics strategy. The role holder will deliver value-prioritised Analytics & AI projects that are closely aligned to the Groups strategic ambition in a scrum team on behalf of internal customers; and contribute to identifying appropriate framework tools and standards to enable Bank of Ireland to become a data driven organisation at all levels of the company.

What is the opportunity?

This is a Group role to lead technical solution delivery for strategic analytics features, realising the value of our Enterprise Data. You will design, develop and deliver high value Customer features to build out a key strategic Data Spine for all Business units across BOI Group, using the latest technologies in Big Data Platforms.

As a Data Engineer, you'll play a leading role in developing one of the most advanced Big Data platforms in the industry (Cloudera), programming in Python and utilising a number of other tools to build data feature pipelines, including Hive, HBASE, Spark, Kafka & Impala.

Key Accountabilities

• Design and implement Hive/Impala Customer features in both the on-premise and cloud space.
• Developing independent key indicators such as customer activity, product penetration, share of wallet and transactional behaviour features for Advanced Analytics Use cases.
• Conducts data science related engineering to create new data marts and productionised data features, to embed and scale machine learning and other analytics models
• Design and implement query engine components for low latency and scalability.
• Support projects in adding new functionality in distributed systems and dealing with concepts of performance, fault-tolerance.
• Work with product managers, Data Scientists and internal customers to understand high value feature requirements and scalable deployment.
• Analyze large-scale distributed systems to identify performance bottlenecks, scalability issues, failure points, and security holes
• Formulate and present your architecture and design documents internally to the Analytics community
• Contribute to software productivity process and infrastructure improvements

Who are You

Essential Qualifications

• Third Level qualification, in mathematics, statistics, finance, IT, or another field including a significant numerical element

Essential Skills / Experience

• A Big Data Engineer with production level experience with one or more Big Data platforms, preferably either (cloud) platforms: Cloudera ,Azure, AWS
• Big Data tools, the most useful being Spark, Impala and Kafka
• You know how to process big datasets as well as streaming data and unstructured data sources, including Hive, Spark, Kafka and Hbase and are eager to further develop yourself in this area
• Experience with data governance, data lineage, and metadata practices
• Experience with build automation tools and strategies
• Familiar with database concepts and Linux development environments.
• Strong troubleshooting, debugging, and performance tuning skills.
• Excellent communication skills.

Desirable Skills / Experience

• Prior experience developing Analytical features for Financial Services Companies.
• Experience with Big Data platforms(Cloudera), Kubernetes, and cloud object storage
• Strong SQL & data integration background, accessing data from disparate systems, as well as cleansing and enriching existing data through the use of techniques such as fuzzy matching and sources like APIs.
• Understanding of process flow, data management, GDPR and data lineage concepts
• Prior involvement in open source community, especially related Apache technologies
• Experience in writing high-performance, enterprise-quality code in python.
• Experience with data warehouse and/or database internals

Location

Working at Bank of Ireland doesn't have to mean working in an office to have an impact. Our commitment to enabling colleagues to thrive means that depending on role type you can have choice and flexibility in where you work and live, subject to your role, customer needs and our requirements. We have a hybrid working model, with home, agile hub and office based options available. We will always list a primary location which can be where you go for in person collaboration, and a location where you can best perform your role.

This job can be done anywhere in the Republic of Ireland/Northern Ireland with the primary office location as Dublin to which travel will be required for in person collaboration.

Exact frequency to be agreed with manager.

Please note you must live in the jurisdiction for the business to which you are contracted.

#li-hybrid #ij-hybrid